Research performance framework

ABSTRACT

There is provided a research framework system. For example, in some implementations there is provided a sleep prediction system for pilots including a first data structure storing collected research data related to pilot sleep patterns, a second data structure storing data related to a flight schedule associated with a pilot, and a sleep prediction module configured to access the data stored in the first and second data structures and calculate, by one or more processors using the data stored in the first data structure, a likelihood that the pilot associated with the flight schedule stored in the second data structure is sleeping at a given time.

BACKGROUND

This disclosure relates generally to electronic systems and moreparticularly to the systems for managing the performance of researchstudies, such as studies related to subjects sleep and performancemeasures. It is essential in many industries to conduct a wide array ofclinical, medical, and/or behavioral studies. Conducting these studiesrequires the manual coordination between numerous study principals,takes months of data compilation and analysis prior to receiving anyresults, and usually does not permit study adjustments, interim results,or real-time analysis of study data.

SUMMARY

There is provided a research framework system including a physicalcondition measurement device configured to measure a physical conditionof a study subject, a first networked device communicatively coupled tothe physical condition measurement device and configured to receive oneor more physical condition measurements related to the study subjectfrom the physical condition measurement device, a second networkeddevice communicatively coupled to the first networked device over anetwork, the second networked device configured to perform the followingoperations using one or more processors: receive the physical conditionmeasurement from the first networked device; store the received physicalcondition measurement in a data structure with physical conditionmeasurements from a plurality of other study subjects, and provide aninterface to perform a study assessment using the physical conditionmeasurement of the study subject and the plurality of other studysubjects. A system of one or more computers can be configured to performparticular operations or actions by virtue of having software, firmware,hardware, or a combination of them installed on the system that inoperation causes or cause the system to perform the actions. One or morecomputer programs can be configured to perform particular operations oractions by virtue of including instructions that, when executed by dataprocessing apparatus, cause the apparatus to perform the actions.

The physical condition measurement device may be configured toautomatically measure a physical condition an aircraft pilot. The secondnetworked device may be configured to provide a prediction of a pilotattribute based at least partially on the physical conditionmeasurements. The first networked device may include a smart phone thatis communicative coupled to the physical condition measurement devicevia a wireless network.

There is also provided a sleep prediction system having a first datastructure storing collected research data related to pilot sleeppatterns; a second data structure storing data related to a flightschedule associated with a pilot; and a sleep prediction moduleconfigured to: access the data stored in the first and second datastructures; and process, by one or more processors using the data storedin the first data structure, a likelihood that the pilot associated withthe flight schedule stored in the second data structure is sleeping at agiven time. Other embodiments of this aspect include correspondingcomputer systems, apparatus, and computer programs recorded on one ormore computer storage devices, each configured to perform the actions ofthe methods.

The sleep prediction system may be implemented such that at least aportion of the data related to pilot sleep patterns was automaticallycollected via one or more physical condition measurement devicesassociated with one or more pilots and/or where at least a portion ofthe data related to pilot sleep patterns was collected by one or moresubjective surveys of one or more pilots. The sleep prediction modulemay be configured to generate a graphical display of pilot sleeppatterns based at least partially on the data stored in the first datastructure. The sleep prediction system may also include one or morephysical condition measurement devices coupled to one or more pilots,wherein the one or more physical condition measurement devices areconfigured to transmit data to the first data structure over a network.

There is also provided a process including providing a first networkedcommunication device for use by a study participant, receiving, usingone or more processors, a study instruction, wherein the studyinstruction instructs the study participant to alter one or more studyconditions, automatically updating data stored in a research-relateddata structure based at least partially on the instruction to the studyparticipant, and communicating the instruction to the first networkedcommunication device over a network. Other implementations of thisaspect may include corresponding computer systems, apparatus, andcomputer programs recorded on one or more computer storage devices, eachconfigured to perform the process.

This process may include providing a second networked communicationdevice for use by a study researcher, wherein the second networkedcommunication device is configured to enable the study researcher togenerate the study instruction. This process may also include providingthird networked communication device for use by a study researchassistant; and communicating the instruction to the third networkedcommunication device over the network, wherein the study instructionfurther directs the study research assistant to alter a research studycondition. This process may also include providing fourth networkedcommunication device for use by a study sponsor, wherein the fourthnetworked communication device is configured to enable the study sponsorto monitor progress of the study. This process may also includeautomatically receiving study related measurement data from the firstnetworked communication device and automatically storing the receivedmeasurement data in one or more data structure associated with aresearch study. This process may also include generating one or moregraphical screens to display a statistical analysis of the receivedmeasurement data.

There is also provided a process including receiving over a network afirst plurality of analytical data related to one or more studyparticipants, wherein the first plurality of data includes dataautomatically collected by one or more physical condition measurementdevice worn by one or more study participants, receiving a secondplurality of analytical data including data associated with one or moreexternal conditions related to each of the one or more studyparticipants, and automatically creating, using one or more processors,a visual representation of a statistical analysis of the first pluralityof analytical data and the second plurality of analytical data. Otherembodiments of this aspect include corresponding computer systems,apparatus, and computer programs recorded on one or more computerstorage devices, each configured to perform the process. This method mayalso include receiving a third plurality of manually entered data,wherein the manually entered data comprises data recorded by the one ormore study participants. This method may also include receiving thefirst plurality of analytical data comprises receiving data recorded byan actigraph. The method may also include receiving the second pluralityof analytical data comprises receiving data recorded by a light sensor.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an example research framework system inaccordance with example implementation;

FIG. 2 is a flow chart of an example process for changing applicationstate in accordance with example implementations;

FIG. 3 is a flow chart of an example mobile device display screen inaccordance with example implementations;

FIG. 4 is a flow chart of another example process for changingapplication state in accordance with example implementations;

FIG. 5A is an example profile generation screen for a PVT device inaccordance with example implementations;

FIG. 5B is an example profile modification screen for a crew profile inaccordance with example implementations;

FIG. 6 is an example screen that may be used to assign one or moreprofiles to a particular study subject;

FIG. 7 is a flow chart of an example process for assessing the resultsof a research study; and

FIG. 8 is an example screen that may be used to display study assessmentresults for a particular study subject.

DETAILED DESCRIPTION

In some implementations described below, a research performanceframework may be designed to perform a variety of research enabling andresearch study analysis functions. For example, the research performanceframework may be configured to conduct a research study into pilot sleepschedules via performance measurements and provide statistical resultson the research topic and provide predictions of future sleep patternsfor pilots that enable better flight operations planning.

Turning to the example implementation of FIG. 1, the illustrated system100 includes or is communicably coupled with a server 102 and one ormore clients 135, at least some of which communicate across network 132.In general, the system 100 depicts an example configuration of a systemcapable of providing a research performance framework via the server 102and the clients 135.

In general, the server 102 is any server that stores one or moreapplications, such as the framework application 104. The frameworkapplication may be executed as software or hardware. In some instances,the server 102 may store a plurality of applications in addition to theframework application 104, while in other instances, the server 102 maybe a dedicated server meant to store and execute only the frameworkapplication 104. In some instances, the server 102 may comprise a webserver, where the framework application 104 is one or more web-basedapplications accessed and executed via network 132 by the clients 135 ofthe system to perform the programmed tasks or operations of theframework application 104.

At a high level, the server 102 comprises an electronic computing deviceoperable to receive, transmit, process, store, or manage data andinformation associated with the system 100. As used in the presentdisclosure, the term “computer” or “computing device” is intended toencompass any suitable processing device. For example, although FIG. 1illustrates a single server 102, system 100 can be implemented using twoor more servers 102, as well as computers other than servers, includinga server pool. Indeed, server 102 may be any computer or processingdevice such as, for example, a blade server, general-purpose personalcomputer (PC), Macintosh, workstation, UNIX-based workstation, or anyother suitable device. In other words, the present disclosurecontemplates computers other than general purpose computers, as well ascomputers without conventional operating systems. Further, illustratedserver 102 may be adapted to execute any operating system, includingLinux, UNIX, Windows, Mac OS, or any other suitable operating system.According to one embodiment, server 102 may also include or becommunicably coupled with an air traffic control system or a flightmanagement system.

In some implementations, and as shown in FIG. 1, the server 102 includesa processor 106, an interface 116, a memory 114, and frameworkapplication 104. The interface 116 is used by the server 102 forcommunicating with other systems in a client-server or other distributedenvironment (including within system 100) connected to the network 132(e.g., client 135, as well as other systems communicably coupled to thenetwork 132). Generally, the interface 116 comprises logic encoded insoftware and/or hardware in a suitable combination and operable tocommunicate with the network 132. More specifically, the interface 116may comprise software supporting one or more communication protocolsassociated with communications such that the network 132 or interface'shardware is operable to communicate physical signals within and outsideof the illustrated system 100.

Generally, the network 132 facilitates wireless or wirelinecommunications between the components of the system 100 (i.e., betweenthe server 102 and the clients 135), as well as with any other local orremote computer, such as additional clients, servers, or other devicescommunicably coupled to network 132 but not illustrated in FIG. 1. Thenetwork 132 is illustrated as a single network in FIG. 1, but may be acontinuous or discontinuous network without departing from the scope ofthis disclosure, so long as at least a portion of the network 132 mayfacilitate communications between senders and recipients.

In still other examples, the network 132 may include a messagingbackbone. The network 132 may be all or a portion of an enterprise orsecured network, while in another instance at least a portion of thenetwork 132 may represent a connection to the Internet. In someinstances, a portion of the network 132 may be a virtual private network(VPN), such as, for example, the connection between the client 135 andthe server 102. Further, all or a portion of the network 132 cancomprise either a wireline or wireless link. Example wireless links mayinclude 802.11a/b/g/n, 802.20, WiMax, and/or any other appropriatewireless link. In other words, the network 132 encompasses any internalor external network, networks, sub-network, or combination thereofoperable to facilitate communications between various computingcomponents inside and outside the illustrated system 100.

The network 132 may communicate, for example, Internet Protocol (IP)packets, Frame Relay frames, Asynchronous Transfer Mode (ATM) cells,voice, video, data, and other suitable information between networkaddresses. The network 132 may also include one or more local areanetworks (LANs), radio access networks (RANs), metropolitan areanetworks (MANs), wide area networks (WANs), all or a portion of theInternet, and/or any other communication system or systems at one ormore locations.

As illustrated in FIG. 1, server 102 includes a processor 106. Althoughillustrated as a single processor 106 in FIG. 1, two or more processorsmay be used according to particular needs, desires, or particularembodiments of system 100. Each processor 106 may be a centralprocessing unit (CPU), a blade, an application specific integratedcircuit (ASIC), a field-programmable gate array (FPGA), or anothersuitable component. Generally, the processor 106 executes instructionsand manipulates data to perform the operations of server 102 and,specifically, framework application 104. Specifically, the server'sprocessor 106 executes the functionality required to receive and respondto requests from the clients 135 and their respective client frameworkapplications 144, as well as the functionality required to perform theother operations of the framework application 104.

Regardless of the particular implementation, “software” may includecomputer-readable instructions, firmware, wired or programmed hardware,or any combination thereof on a tangible medium operable when executedto perform at least the processes and operations described herein.Indeed, each software component may be fully or partially written ordescribed in any appropriate computer language including C, C++, Java,Visual Basic, assembler, Perl, any suitable version of 4GL, as well asothers. It will be understood that while portions of the softwareillustrated in FIG. 1 are shown as individual modules that implement thevarious features and functionality through various objects, methods, orother processes, the software may instead include a number ofsub-modules, third party services, components, libraries, and such, asappropriate. Conversely, the features and functionality of variouscomponents can be combined into single components as appropriate.

The framework application 104 may be implemented may be implemented asEnterprise Java Beans (EJBs) or design-time components and may have theability to generate run-time implementations into different platforms,such as J2EE (Java 2 Platform, Enterprise Edition), ABAP (AdvancedBusiness Application Programming) objects, or Microsoft's .NET, amongothers. Additionally, the framework application 104 may be a web basedapplication accessed and executed by remote clients 135 or clientframework applications 144 via the network 132 (e.g., through theInternet). Further, while illustrated as internal to server 102, one ormore processes associated with a framework application 104 may bestored, referenced, or executed remotely. For example, a portion of theframework application 104 may be a web service associated with theapplication that is remotely called, while another portion frameworkapplication 104 may be an interface object or agent bundled forprocessing at a remote client 135. Still further, portions of theframework application 104 may be executed by a user working directly atserver 102, as well as remotely at client 135.

The server 102 also includes memory 114. Memory 114 may include anymemory or database module and may take the form of volatile ornon-volatile memory including, without limitation, magnetic media,optical media, random access memory (RAM), read-only memory (ROM),removable media, or any other suitable local or remote memory component.Memory 114 may store various objects or data, including classes,frameworks, applications, backup data, business objects, jobs, webpages, web page templates, database tables, repositories storingbusiness and/or dynamic information, and any other appropriateinformation including any parameters, variables, algorithms,instructions, rules, constraints, or references thereto associated withthe purposes of the server 102 and the framework application 104.Additionally, memory 114 may include any other appropriate data, such asVPN applications, firmware logs and policies, firewall policies, asecurity or access log, print or other reporting files, as well asothers.

At a high level, the memory 114 may include three data structures—aprofile database 108, a common data structure 110, and a results dataset structure 112, each of which are described below with regard to FIG.2. It should be understood, however, that the structures 108, 110, and112 are merely exemplary and in other implementations, the memory 114and indeed any suitable data storage used by the framework application104 may be organized in a variety of suitable organizations. In variousimplementations, the data structures 108, 110, and 112 may be stored aspart of the framework application 104 or in another suitable storagelocation.

The system 100 may also include one or more clients 135. Each client 135may be any computing device operable to connect to or communicate withat least the server 102 and/or via the network 132 using a wireline orwireless connection. Further, as illustrated by client 135 a, eachclient 135 includes a processor 141, an interface 138, a graphical userinterface (GUI) 138, a client application 144, and a memory 147. Ingeneral, each client 135 comprises an electronic computer deviceoperable to receive, transmit, process, and store any appropriate dataassociated with the system 100 of FIG. 1. It will be understood thatthere may be any number of clients 135 associated with, or external to,system 100. For example, while illustrated system 100 includes fourclients (135 a, 135 b, 135 c, and 135 d), alternative implementations ofsystem 100 may include a single client 135 communicably coupled to theserver 102, or any other number suitable to the purposes of the system100.

Additionally, there may also be one or more additional clients 135external to the illustrated portion of system 100 that are capable ofinteracting with the system 100 via the network 132. Further, the term“client” and “user” may be used interchangeably as appropriate withoutdeparting from the scope of this disclosure. Moreover, while each client135 is described in terms of being used by a single user, thisdisclosure contemplates that many users may use one computer, or thatone user may use multiple computers. As used in this disclosure, client135 is intended to encompass a personal computer, touch screen terminal,workstation, network computer, kiosk, wireless data port, smart phone,personal data assistant (PDA), a dedicated research terminal, one ormore processors within these or other devices, or any other suitableprocessing device.

The clients 135 may also be “smart” or internet enabled appliances. Forexample, the clients may be measurement devices or sensors capable ofindependent and automatic communication over one or more networks. Theclients may be any suitable form measurement device or sensor including,but not limited to, activity meters, sleep sensors, actigraph devices,psychomotor vigilance task (PVT) devices, pedometer, body temperaturesensors, medical sensors (such as heart rate sensors or blood pressuresensors), light sensors, telemetry sensors, and/or circadian sensors.For example, in some implementations, one of the clients 135 may includea physical sensor configured to communication over a wireless networkeither by itself or in combination with a smart phone, such as Bluetoothenabled sensor in communication with a smartphone or tablet computer.

Each client 135 may comprise a computer that includes an input device,such as a keypad, touch screen, mouse, or other device that can acceptuser information, and an output device that conveys informationassociated with the operation of the server 102 (and frameworkapplication 104) or the client 135 itself, including digital data,visual information, the client application 144, or the GUI 138. Both theinput and output device may include fixed or removable storage mediasuch as a magnetic or solid state storage media or other suitable mediato both receive input from and provide output to users of the clients135 through the display, namely, the GUI 138. As described above, inmany implementations, one or more of the clients may be a networkeddevice or computer system.

As indicated in FIG. 1, the clients 135 may be associated withparticular users of the system 100. For example, the client 135 a may beassociated with a study subject, such as a pilot. Client 135 b may beassociated with a study sponsor, such as a corporation or governmentalinterest that may fund the performance of a research study. Client 135 cmay be associated with a study researcher, such as a research scientist,that formulates a research study and tracks its progress. Client 135 dmay be associated with a research assistant that is responsible forinteracting with the study subjects during the course of the study. Itwill be understood, however, that the assignment of clients 135 in FIG.1 is exemplary and clients 135 may be assigned or associated with studyprincipals in any suitable manner. One of the clients or the server 102may communicate one or more study condition or instructions over thenetwork 132 to another one of the clients 135, such as study subject orstudy research assistant. In this way, the system 100 may enable a studyprincipal, such as a study scientist or study sponsor, to communicatestudy conditions and instructions to automatically and/or efficiently tostudy principals in one or more studies via a single study framework. Itwill also be understood that the system 100 may include a variety ofadditional clients 135 not illustrated in FIG. 1, such as administratoror network support systems.

Further, the illustrated clients 135 include a GUI 138 comprising agraphical user interface operable to interface with at least a portionof system 100 for any suitable purpose, including generating a visualrepresentation of the client application 144 (in some instances, theclient's web browser) and the interactions with the frameworkapplication 104, including the responses received from the frameworkapplication 104 received in response to the requests sent by the clientapplication 144. Generally, through the GUI 138, the user is providedwith an efficient and user-friendly presentation of data provided by orcommunicated within the system. The term “graphical user interface,” orGUI, may be used in the singular or the plural to describe one or moregraphical user interfaces and each of the displays of a particulargraphical user interface. Therefore, the GUI 138 can represent anygraphical user interface, including but not limited to, a web browser,touch screen, or command line interface (CLI) that processes informationin system 100 and efficiently presents the information results to theuser.

In general, the GUI 138 may include a plurality of user interface (UI)elements, some or all associated with the client application 144, suchas interactive fields, pull-down lists, and buttons operable by the userat client 135. These and other UI elements may be related to orrepresent the functions of the client application 144, as well as othersoftware applications executing at the client 135. In particular, theGUI 138 may be used to present the client-based perspective of theframework application 104, and may be used (as a web browser or usingthe client application 144 as a web browser) to view and navigate theframework application 104, as well as various web pages located bothinternal and external to the server, some of which may be associatedwith the framework application 104.

For purposes of the present location, the GUI 138 may be a part of orthe entirety of the client application 144, while also merely a tool fordisplaying the visual representation of the client and frameworkapplication 104 actions and interactions. In some instances, the GUI 138and the client application 144 may be used interchangeably, particularlywhen the client application 144 represents a web browser associated withthe framework application 104.

While FIG. 1 is described as containing or being associated with aplurality of elements, not all elements illustrated within system 100 ofFIG. 1 may be utilized in each alternative implementation of the presentdisclosure. Additionally, one or more of the elements described hereinmay be located external to system 100, while in other instances, certainelements may be included within or as a portion of one or more of theother described elements, as well as other elements not described in theillustrated implementation. Further, certain elements illustrated inFIG. 1 may be combined with other components, as well as used foralternative or additional purposes in addition to those purposesdescribed herein.

Turning next to FIG. 2, a block diagram of an example implementation ofthe framework application 104 in communication with data structures 108,110, and 112 is shown. The framework 104 may include a central researchmanagement module 150. As shown in FIG. 2, the module 150 is configuredto communicate with the structures 108, 110, and 112 to create andmanage research studies. For example, the module 150 may be configuredto provide a registration capability, such as to add a new study to thesystem 100 or to add a new study principal, such as a study subject orresearch assistant. As described below in regard to FIG. 4, theframework application 104 may perform registration by adding one or moreprofiles to the profile database 108.

Next, the module 150 may include a framework manager that enablesmanagement of one or more research studies by the system 100 andcommunication between study principals, over the network 132 (forexample) using one or more processors in the server 102 and the clients135. The framework manager may also enable a study principal, such as astudy researcher or a study sponsor, to configure one or more parametersof the study, including but not limited to the number of participants,the length of the study, or the goals of the study. The frameworkmanager may also be configured, as described below, to permit the entryor adjust of a variety of study profiles, including subject profiles,device profiles, and schedule profiles.

The module 150 may also include a performance analyzer that isconfigured to analyze, calculate, and/or assess the results of researchstudy. If the framework application 104 is being used in a studyinvolving sleep, such as a study directed to pilot sleep, the module 150may also include a sleep analyzer. As described below, the performanceanalyzer may be configured to receive study result data either manuallyor automatically from one or more physical condition measurementdevices. For example, the performance analyzer can be configured todetermine sleep/wake interruptions, to determine opportunities forsleep, or to determine sleep patterns. In some implementations, theperformance analyzer may be a part of the framework manager.

The module 150 may also include a performance predictor. The performancepredictor can be configured to process data, such as data from the datasets 112 and predict a future value of a study variable and/orcondition. For example, in the case of pilot study, the performancepredictor may be configured to analyze sleep data for one or more pilotsbased on one or more references or profiles, such as time, aircraft,route, timezone, etc., and to generate predictive data regarding thelikely sleep for a pilot associated with that reference or profile.

The performance predictor enables the framework application 104 to beused predictively to evaluate the effects of changes to the profile tothe study results. For example, a study researcher can via one or moreprocessors to adjust a study profiles or assessment to generatepredictive data from the system 100 regarding the future predictedperformance of one or more study subjects. This predictive data couldthen be used either automatically or manually to assign one or morepilots, routes, schedules, or flight plans. In some implementations, theframework application 104 may use an iterative process to evaluatepredictive outcomes for varying conditions for study subjects or similarpopulations. For example, the framework application may iterativelyperform a fatigue prediction for pilots and predict those pilots basedon the study results that are likely to have the least or lower fatiguewhen flying a particular route, schedule aircraft, etc. However, this isonly an example and the framework application 104 may be used to predictperformance of based on any suitable study characteristic.

The module 150 may also include one or more administrative managers orfunctions. For example, FIG. 2 illustrates that module 150 include ashipping manager that is configured to manage the shipping of studymaterials to study principals, such as the subjects or the researchassistants.

As shown in FIG. 2, the profile database 108 is a data structureconfigured to store one or more research study profiles. A profile is ageneral configuration structure that defines one or more variablesassociated with a physical device, a study participant, or other studyaspect. For example, as shown in FIG. 2, the profile database 108 mayinclude one or more physical device profiles, such as actigraphprofiles, for example, Actiwatch 2 or Actiwatch Spectrum, PVT deviceprofiles, sleep monitor profiles, and so forth. The profile database mayalso include subject profiles. The profile database 108 may also includeschedule profiles that define one or more research or flight schedule.The profile database 108 may further include one or more other studyrelated profiles. Notably, as described further below, the profiles inthe profile database 108 may be created and modified by one the studyprincipals using the research framework 104.

The framework application 104 may also be coupled to a common datastructure 110 in some implementations. The common data structure 110 mayinclude a database of environmental and external conditions or factorsthat change less often than the profile data and generally affect theresearch study. In the example shown in FIG. 2, the common data 110includes location information, schedule information, time zone, andaircraft information, for example. The common data 110 may also includelanding information, sleep types, regions, commute length information,country information, measurement scales, and/or a wide variety of otherstudy related data depending on the type of study being managed by theframework application 104.

Next, the framework application may be coupled to one or more data sets112. The data sets 112 include the data collected by the study. In someimplementations, the collection of the data in the data sets 112 may beperformed automatically by the client 135 a. For example, the client 135a may be configured to use a physical condition measurement device, suchas an actigraph or PVT device, to automatically record one or morephysical condition measurements using one or more processors and on aperiodic basis automatically upload study data to the framework 104 overthe network 132.

The data sets 112 may also be populated using anyone of number of othersuitable techniques. For example, the data in the data sets may bemanually entered either by a study subject, such as by a pilot, or by aresearch assistant. A pilot could manually enter information on theclient 135 from a sleep schedule or a fatigue log, and the client wouldthen upload that information to the data sets 112. The data sets 112 mayalso be populated via one or more tests or trials performed by theresearch assistant. For example, the research assistant may administer areaction test to a pilot and record the results (via the client 135 d)to the data sets 112.

FIG. 3 is a flow chart of example process 200 for automaticallycollecting and compiling physical study data from study subjects. Insome implementations, the process 200 may be performed by the frameworkapplication 104 and/or the client 135 a. As shown in FIG. 3, the process200 may begin by measuring a physical condition of a study subject, asshown in block 202. In some implementations, the physical conditionmeasurement may be performed automatically by one or more physicalcondition measurement devices configured to communicate with or be apart of the client 135 a, such as by a physical condition measurementdevice coupled via Bluetooth with a smartphone or tablet. As describedabove, the physical condition of the study subject may be measure by anysuitable clinical, medical, or environmental sensor or measurementdevice. For example, the measurement may be taken by an actigraphdevice, PVT device, sleep sensor, temperature sensor, activity sensor,or darkness sensor. In some implementations, the device taking themeasurement may not be physical connected to the study subject, forexample, the sensor taking the measurement may located in the subject'senvironment or elsewhere.

As shown in block 204, the next step in the process 200 may involve thetransmission via one or more processors and the network 132 of thephysical condition measurement data to the framework application 104.For example, the client 135 a may transmit data collected from anactigraph device over the internet to the server 102 upon which theframework application 104 is executing.

As shown in block 206, the next step in the process 200 may includeidentifying a device profile associated with the physical conditionmeasurement data provided. For example, the framework application 104may identify that the physical condition measurement data was collectedby a particular model of actigraph device. Next, the frameworkapplication 104 may process the received data in view of the profile ofthe measurement device to extract desired study data, as shown in block208. In some examples, the framework application may process thereceived data to compiled sleep schedule or an activity schedule.

Next, as shown in block 210, the process 200 may include storing thedata in a data set associated with the processed physical data. Forexample, the processed data may be stored in one more data sets 112.Lastly, the process 200 may include making the data available forresearch queries, as shown in block 212. For example, the frameworkapplication 104 may enable the querying of the data set and the realtime production of one or more graphically displays of research data toenable the selection of pilots or the assignment of pilot schedules.

FIG. 4 is a flow chart of an example process 250 for creating ormodifying a study profile. The process 250 may be used by the frameworkapplication 104 to enable a study principal to add or modify a subjectprofile, device profile, or other suitable study profile. As shown inFIG. 4, the process 250 may begin with a request from a study principalto create or modify a profile, such as a physical device profile or astudy profile. For example, in some implementations, the request may bea request to create a profile for an actigraph device that will be wornby a study subject.

As shown in FIG. 4, the process 250 may continue with block 254 withdetermining whether the request is associated with an existing profile.If the request is not associated with an existing profile, a screen togenerate a new profile may be created, as shown in block 256. If on theother hand, there is an existing profile associated with the request,that profile will be loaded, as shown in block 257, and a profilemodification screen will be displayed on GUI 138, as shown by block 258.

Exemplary profile generation/management screens are shown in FIGS. 5Aand 5B. As illustrated, an example profile generation screen for a PVTdevice 270 is shown in FIG. 5A. As shown, the profile generation screenincludes one or more data entry fields that enable a study principal toenter relevant information related to a particular profile. In the caseof the illustrated PVT device, the profile could include a profile ID, adescription, a manufacturer, a model number, a size, a weight, andsoftware name and version numbers among other information. As notedabove, the use of individual profiles for devices, studies, crews, andsubjects enables both simpler design and management of the study and thestudy equipment, but also the ability to the modify conditions,participants, or equipment of the study with relatively littledisruption to the study, the subjects, or the research assistants.

FIG. 5B illustrates an example profile modification screen 280 for acrew profile. As illustrated, the screen 280 may include a variety ofdata fields related to an aircraft crewmember that may be involved in astudy. The framework application 104 may be configured to populate thefields in the screen 280 with information from the profile database 108to enable a study principal to modify one or more attributes of the crewprofile.

Returning to FIG. 4, next, the process 250 may include receiving new ormodified profile data from a study principal, as shown in block 260. Theprofile data can then be uploaded into the profile database 108, asshown in block 262. Lastly, as shown in block 264, once a profile isupdated in the profile database, the framework application 104 mayupdate research study information based on the updated profile. Theframework application will also be configured to apply the updatedprofile to newly received research data received from the client 135 a.In this way, the framework application 104 is enables a study principal,such as a study researcher or research assistant, to replace or changestudy devices or participants throughout the progress of study withoutthe need to abandon an existing study and begin anew.

Once profiles are created or modified, configurations may be created forthe one or more study subjects. FIG. 6 shows an example screen 300 thatmay be used to assign study subject configurations. The screen 300 maybe displayed on the GUI 138 or on another display in the system 100. Thescreen 300 provides an interface for a study principal to assign one ormore study configurations to a particular study subject. For example,FIG. 6 depicts the assignment of a study profile number, crew profilenumber, schedule profile number, actigraph device profile number and PVTdevice profile number to a plurality of study subjects identified by IDnumber. Advantageously, the screen 300 via one or more processors 106 onthe server 102 enables a study principal to dynamically adjust theprofiles associates with a particular study subject based on studychanges, such as a change in equipment or a change in flight schedule.

Turning next to FIG. 7, a flow chart of an example process 320 forassessing the results of a research study is shown. In someimplementation, the process 320 may be performed by the applicationframework 104 or another suitable component in the system 100. As anexample, the process 320 is described in the context of a pilot sleepassessment, but it should be understood that the process 320 might beused to assess the results of a variety of suitable forms of researchstudies.

As shown by block 322, the process 320 may begin by receiving a requestfor a study assessment. In various examples, a study assessment mayinvolve analyzing and displaying the results of an on-goingstudy—including real time results collected from the clients 135a-d—and/or may involve calculating a predictive analysis (as describedabove), for example, a prediction of future pilot performance based onflight time.

The process 320 continues as shown in block 324 by determining what datasets, such as the data sets 108, are needed to perform the requestedstudy assessment. In various implementations, determining the data setsinvolves identify one or more flight data related data set that wereautomatically collected from pilots. In various implementations,determining the data sets may also include identifying data from theprofile database 108, the common data 110, or other suitable storagelocations.

Next, the process 320 involves determining a graphical format forassessment, as shown in block 326. The format for the assessment may bedetermined by the framework application 104 based on preset selections,may be dynamically assigned based on a characteristic of the study,and/or may be selected based on a user choice. The graphical format willbe used to display the results of the study assessment, although in someimplementations, the assessment may be displayed non-graphically, forexample as summary text results.

The process 320 then involves performing an analysis of the data sets,such as a statistical analysis of the data sets 112, to produce thestudy assessment, as shown by block 328. In various embodiments, theanalysis of the study data sets may include determining sleep wakecurves, determining performance at various hours of the day or into aflight, determining the interplay between any collected study data, orany other desired analysis of the study data. The statistical analysismay involve analyzing the data on the basis of sleep times, time of day,initial condition or fatigue, schedule, geographic location, time zone,and/or other suitable factors. In some implementations, the studyassessment may include performing a dynamic intersections between two ormore data sets to identify commonalities, probabilities, or otherstatistical relationships between the data stored in the data sets 112.

Next, the study assessment may be displayed, as shown by block 332. Insome implementations, the study assessment may be displayed on the GUI138, although any suitable display device may also be used. Lastly, theprocess 320 may determine if the requested study assessment was apredictive assessment, such as a predictive assessment of performance,as indicated by block 332. If the assessment was predictive, the process320 may next involve changing a study related assignment in view of theassessment. For example, the process 320 may involve changing a flightschedule or a crew assignment based on a predictive assessment of pilotperformance or of pilot sleep/wake patterns. In some implementations,the process 320 may involve providing a pilot assignment recommendationbased on the study assessment result. For example, the frameworkapplication may be configured to statistical calculate a pilot with ahigh percentage chance of being sufficiently rested based on data storedwithin the data sets. In some implementations the process 320 mayinclude merging the results of multiple studies and/or comparingsubjects or group of subjects across those multiple studies.

FIG. 8 shows an example screen 350 that may be used to display studyassessment results for a particular study subject. In particular, theexample screen 350 displays sleep pressure curves being generated inreal-time or near realtime from one or more clients 135. As describedabove in relation to FIG. 7, the screen 350 and the assessment within itcan be generated from the data set 108, including real time study datacollected over the network 132. The study assessment on the screen 350may be used either automatically by the system 100 or manually by astudy principal to assign flight crews or aircraft routes. As notedabove, however, the screen 350 is merely exemplary and in variousimplementations any suitable form of statistical or prediction analysisof the study data may be displayed on the screen 350 or other screensgenerated by the system 100.

While this document contains many specific implementation details, theseshould not be construed as limitations on the scope of what may beclaimed, but rather as descriptions of features that may be specific toparticular implementations or embodiments. Certain features that aredescribed in this specification in the context of separate embodimentscan also be implemented in combination in a single embodiment.Conversely, various features that are described in the context of asingle embodiment can also be implemented in multiple embodimentsseparately or in any suitable sub combination. Moreover, althoughfeatures may be described above as acting in certain combinations andeven initially claimed as such, one or more features from a claimedcombination can, in some cases, be excised from the combination, and theclaimed combination may be directed to a sub combination or variation ofa sub combination.

1. A research framework system comprising: a physical conditionmeasurement device configured to measure a physical condition of a studysubject; a first networked device communicatively coupled to thephysical condition measurement device and configured to receive one ormore physical condition measurements related to the study subject fromthe physical condition measurement device; a second networked devicecommunicatively coupled to the first networked device over a network,the second networked device configured to perform the followingoperations using one or more processors: receive the physical conditionmeasurement from the first networked device; store the received physicalcondition measurement in a data structure with physical conditionmeasurements from a plurality of other study subjects; and provide aninterface to perform a study assessment using the physical conditionmeasurement of the study subject and the plurality of other studysubjects.
 2. The research framework system of claim 1, wherein thephysical condition measurement device comprises an actigraph device. 3.The research framework system of claim 1, wherein the physical conditionmeasurement device is configured to automatically measure a physicalcondition an aircraft pilot.
 4. The research framework system of claim3, wherein the second networked device is configured to provide aprediction of a pilot attribute based at least partially on the physicalcondition measurements.
 5. The research framework system of claim 1,wherein the first networked device comprises a smart phone that iscommunicative coupled to the physical condition measurement device via awireless network.
 6. A research system for pilots comprising: a firstdata structure storing collected research data related to pilot sleeppatterns; a second data structure storing data related to a flightschedule associated with a pilot; and a data processing moduleconfigured to: access the data stored in the first and second datastructures; and process, by one or more processors using the data storedin the first data structure, a likelihood that the pilot associated withthe flight schedule stored in the second data structure is sleeping at agiven time.
 7. The research system of claim 6 wherein at least a portionof the data related to pilot sleep patterns was automatically collectedvia one or more physical condition measurement devices associated withone or more pilots.
 8. The research system of claim 6, wherein at leasta portion of the data related to pilot sleep patterns was collected byone or more subjective surveys of one or more pilots.
 9. The researchsystem of claim 6, wherein the sleep prediction module is configured togenerate a graphical display of pilot sleep patterns based at leastpartially on the data stored in the first data structure.
 10. Theresearch system of claim 6, comprising one or more physical conditionmeasurement devices coupled to one or more pilots, wherein the one ormore physical condition measurement devices are configured to transmitdata to the first data structure over a network.
 11. A method forhosting a research performance system comprising: providing a firstnetworked communication device for use by a study participant;receiving, using one or more processors, a study instruction, whereinthe study instruction instructs the study participant to alter one ormore study conditions; automatically updating data stored in aresearch-related data structure based at least partially on theinstruction to the study participant; and communicating the instructionto the first networked communication device over a network.
 12. Themethod for hosting of claim 11 comprising providing a second networkedcommunication device for use by a study researcher, wherein the secondnetworked communication device is configured to enable the studyresearcher to generate the study instruction.
 13. The method of claim 12comprising: providing third networked communication device for use by astudy research assistant; and communicating the instruction to the thirdnetworked communication device over the network, wherein the studyinstruction further directs the study research assistant to alter aresearch study condition.
 14. The method of claim 13 comprising:providing fourth networked communication device for use by a studysponsor, wherein the fourth networked communication device is configuredto enable the study sponsor to monitor progress of the study.
 15. Themethod of claim 11, comprising automatically receiving study relatedmeasurement data from the first networked communication device andautomatically storing the received measurement data in one or more datastructure associated with a research study.
 16. The method of claim 15,comprising generating one or more graphical screens to display astatistical analysis of the received measurement data.
 17. A methodcomprising: receiving over a network a first plurality of analyticaldata related to one or more study participants, wherein the firstplurality of data includes data automatically collected by one or morephysical condition measurement device worn by one or more studyparticipants; receiving a second plurality of analytical data includingdata associated with one or more external conditions related to each ofthe one or more study participants; and automatically creating, usingone or more processors, a visual representation of a statisticalanalysis of the first plurality of analytical data and the secondplurality of analytical data.
 18. The method of claim 17 comprisingreceiving a third plurality of manually entered data, wherein themanually entered data comprises data recorded by the one or more studyparticipants.
 19. The method of claim 17, wherein receiving the firstplurality of analytical data comprises receiving data recorded by anactigraph.
 20. The method of claim 17, wherein receiving the secondplurality of analytical data comprises receiving data recorded by alight sensor.